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Abstract 



The Kaiser Meaaures of Sampling Adequacy (MSA) were derived for a typical 
six-concept Semantic Differential. The overall indices indicated that both 
concept and total correlation matrices would lead to comparable decisions 
_^regardlng the psychometric quality of the sample data sets. The individual 
MSA's, however, revealed considerable varlabiUcy for some scales placing 
several in a range which woiild aake them auspect in a psychomatrlc sensa. It 
was recommended that the concepts of psychometric adequacy be used ±n deter- 
mining the efficacy of one's SBraantlc Differential data for factor analytic 
procedures, . ^ 



Of the many assessment techniques developed in the past decades, the 
Semantic Differehtial (SD) has been incorporated Into an astounding number 
of studies. The device presents some attractive alternativas to more tra» 
ditional instruments in that for ona administration the responses yielded 
by the SD produce a large amount of data. Customarily the semantic space 
is portrayed as three-dimensional and Euclidean in nature. Through effective 
selection of scales and/or concepts^ the instrument may be tailored to the 
specific situation encountered by the Investigator and with proper con- 
struucion/ completed with a minimum of time and effort* These with ad= 
ditionaily favorable considerations have made it possible to find in almost 
every behavioral research journal at least some studies for which the SD 
had been the fundamental data collection device* See for example: Aiken, 
1970; Aiken, 1972; Aiken and Dreger, 1961; Anttonen^ 1969; Divesta, 1966| 
Duttons 1956; Husek and Wittrock, 1962; Jenkins and Sucij 1958; McCallon 
and Brovm, 1971; Neale, 1969; Neale and Proshek^, 1967rTanaka, Oyama and 
Osgood j 1963; Yamamato, Thomas and Karns^ 1969| Yamamato, Thomas ^ and 
4/elrsraa, 1969 « 

In additlonj it has been subject to a large number of studies regarding 
its psychometric properties. This is best attested to by the recent volume 
edited by Snider and Osgood (1969> . Many investigators such as Osgood and 
Succl (1955) have been concerned with factorial methods of structuring 
Semantic Differential dimensloriality * Miron and Osgood (1966) noted that ' 
the literature of -Semantic Differential research over a period of twelve 
years indicated that the scale hy concept Interaction was aJften documented 
but found little evidence for person by scale structure interaction. Deutsche 
man (1959) reported that in factor analytic cases studied there were isolated 



three factors=-evaluatian, potency, and activity. McKie and Foscer (1972) 
propoaad a modal in .hlch evaluative scales «ere detarained through factor 
analytic methods with subsaquant determination *f concept clusters achiavad 
through the analysis of parson by concept data, Komarita and Bass (1967) 
raporced finding thraa avaluativa factors while Bashook and Foster (1973) 
arguad that there ^as only one effective factor in tho.a data. Mo.s (1950) 
found various sets of concepts to alter scale factor patterns, while Paabody 
(1967) indlcatad that the typically found evaluative factor resulted from a 
confounding of evaluative and descriptive dimensions. 

Tanaka and Ossood (1965) Identified a good deal of cross-cultural pattern 
stability in the Semantic Differencial. Rosenbau«. Rosenbau,., and*McGinnis ^ 
(1971) indicated that patterns differed considerably with varying concepts. 
Recently Magulre (1973) in a comprehanaive review , of Semantic Differential 
n,ethodolosy recommandad that tha method of principal components be abandoned 
and replaced with the factor anal^rtlc or image modal. From these results it - 
seems clear that factoring procedures have played a large part in structuring 
the dimensionality of Semantic Oiffarential data. , 

Recently Kaiser (1970) announced the davelopmant of a Measure of Sampling 
Adequacy (MSA) which is intended to assess the degree to which a sat of 
variables under consideration coo^prise an adequate sample (psychometric) from 
the domain of Interest. The index may be used as the basis of a decision 
rule for determining whether a given sample correlation matrix should be 
factored In an exploratory sense (Cerny and Kaiser, In Press)., The fundamental 
theory underlying the Measure (Guttman. 1953) is that as the sample data con- ; 
form to factor analytic tenets, the maCrlK of their co^rclctlons should have 
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.n inverse R-l „Hi=„ ,ppro.ch.s a dl.gc„al . Di.j). Kaiser and Rice 

(1974) using this property defined the MSA a f™etlo„ of the antl l.age 
correlation „atrl. Q . SR-Is where - (Blag and the ohserved sample 

correlation macrix (R) ; 



It r2jk 

MSA = 



The index lies between zero and one (0 < MSA > n „-f^>, i • 

S.W nsA >^ I) with values increasing with' 

the psychometric, quality of i-he H-.r= 

ity ot the daca. The present accepted calibration for 



MSA is as follows: 



in the .90's - marvelous 
In the .80's - meritorious 
In the .70's - middling 
In the .60's - mediocre 
In Che .50's - miserablo 
Below .50 - unacceptable 



A similar measure may be defined for individual variables. 



Er2jk 

k 

MSACj) s k^1 



ZrZjk + EqZjk 
k k 



The individual index is intended to assess whether a particular variable 
represents the domain of interest and thus should be included in the sample 



data set. 



While holdins the others constant, the MSA appears to improve as (a) the 
number of variables increase., (b) the (cff.ctlvo) number of factors decreases. 
(d> the number of subjects increases, and (d) the general lavel of correlation 
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increases. Recent studies with the MSA (Dzluban and Shlrkey. 1974A; Dziuban 
and Shirkey, 1974Bj Shirkoy and DEiuban, 1976) have shown that It signals 
random variables In a data set and that it would readily guard against data 
where the population correlation maerix was an identity (R =- I). Monte carlo 
studies of the index CCerny and Kaiser, In Press; Meyer, Kaiser, and Cerny, 
In Press; Dzluban and Shirkcy, 1976) have shown it to be most influenced by ' 
the number of variables P. 

The purpose of this study was to assess variations in the sampling 

adequacy of Semantic Differential scales when used with differing concepts. 

In a general sense it was a study of the psychometric interaction of scales 

and concepts . 

Procedures ' ' ■ 

A six concept Semantic Differential was administered to a sample of five 
hundred fifteen public school teachers in the Central riorida area. The 
concepts Death, Hero, Quicksand, Success, Gentleness and mitm Rosebuds were 
among those used by Osgood, Succi and Tannenbaum (1957) to develop the instru- 
ment. Thirty scales Cevalurtion, potency, and activity) were selected for 
use from the thesaurus published by the developers. The order and polarity 
of scale presentation was randomly assigned. The order of concept presentation 
was varied randomly from a list of twelve possibilities. The scale inter- ~ 
correlation matrices were derived for each of the concepts as well as for 
the strung out or collapr,cd matrix. The overall and individual Heasuros of 
Sampling Adequacy (MSA) were computed for each of the seven matrices. Although 
not reported in this paper, the rescaled image components were computed for 



each r,. „e co„po„.„„ re.a.„.. ..e 

Of eisenvalue. R _ ^ ^^^^^^^^ ^^^^^^^^ 

Study. 

Results 

Th. ovo„ll M.a.„..s Of sa.pu„g Adequacy («s« and „.„t.r of co„po„a„„ 

ara presented in Table I. 



Insert Table 1 About H 



eTe 



U b. obs„v.d .ha., had Ch. MSA crl.ar.on hac„ uaad cxclualv.l, .a a 
f...o„MlU>, d.cl.io„ rule. alX „^^^^^ 
Prla...'. the highest ove^aU MSA (.98) „.= obtained for Hero and the loweat' 
-atH (MSA . .35,. u Is „„„K. cf note that th. totaX sa„pXe did not pro- 
duce the largest value CMSA - .88). although the effective „„„het of subjects 
appeared to be 30,0. Kurther It „ay be observed that there »s substantial 
variability 1„ the nu.ber of retained components. The largest „™ber (eight, 
was Obtained for Qule.sand and the lo„est (three, for Hero, „hlle the total 
sample produced six components. 

The individual MSA's are presented in Table II. " 



Insert Table 11 About Here 



" one wore to vle„ a. .uspcct varl.bl.s with value, below . 70, a seric 
Of psychometric interactions „ay be observed. A sugary of those scales Is 

presented in Table IIi; 
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Insert Table III Abouc Here 

For at least one concept eight f20 05^^ of t-k^ «... 

eignt uu^U4; of the original thirty scales 

produced an MSA whxch would be considered very euspect. Five of .hose were 
related to the originally defined activity factors „ith one each for potency 
and evaluation. None of the scales, however.' Wthin the context of the 
strung out matrix produced an IndlvlduaL MSA which nort, ally would Mandate 
further scrutiny. Of the six concepts. Death and White Rosebuds produced 
the largest „„.ber of unacceptable values, four and five respectively, while 
Quicksand produced three. Success and Gentleness produced one low value each 
While Hero was the only concept .which failed to yield any clearly unacceptable 
MSA levels. 

Discussion 

Through tha us. of so^a kind of factoring procedure, it haa bean and still 
is common practice to assess the undarlying dimensionality of Semantic Dlf- 
farentlav data. Much of this work has been exploratory In nature, although 
Often the intent has been to retrieve the evaluation, potency, and activity 
dimensions. Because of its three=dl.ensional nature, exploratory factor 
-nalysis of semantic Differential data has Presented complex analysis pro- : 
blems. If one Wishes to analyze a two^dln^enslonal array of scales, however, 
two primary options are available. The first. 'which Is rarely done. Is tb ^ 
analyse the scales for each concept separately and subsequently coo.pare the 
similarity of the factors. The second method involves deriving th. factors .: 
for tha atrung out matrix by collapsing the concepts and forcing non- : 
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independent observations. Me have assessed the overall psychometric adequacy 

of the one data set in both situations and found It to be acceptable. In 
addition, individual Indices for the strung out. matrix showed all- of the 
.. .variables to be at least minimally adequate. From this one might assume 
that they could proceed with the proposed factoring procedures. 

The results of theconcept faGtoring, however, indicated that certain 
precautions should be taken in these, . circums tanees . The change in psycho- 
metric adequacy of some scales , when used with different concepts, may indicate 
a change in domain relatedness. This becomes evident when one "dissects" 
the Semantic Differential. When the individual MSA's for the bverall matrix 
were computed the scale pair Weak-Strong produced a value (.79) which would 
by present calibration standards lead one to decide that it had an acceptable 
domain relatedness . -.tt j^^ however, produce decidedly inferior values for 
two of the concepts (.46, . 59)7 " 'flift^f ect of collapsing the concepts was 
to obscure the inferior MSA's. Since this pcc^^-^yLth eight scales, it 
seems worthy of consideration. . ^ . 

Ttvii •sesuits of this study suggest that, depending on Che concept, appli- 
cation of a common deciaion rule ( A >^ 1) to Semantic Differential data will 
produce largaly disparate numbers of components. With as many as eight and 
as few as thrco dimonsions found in the separate concepts the total of six 
in the overall matrix suggested "average" components. Apparently' through' the 
same decision rule WO have over or under factored each one o£,^he conceptsT^"^^-.^ 
The data from the Semantic Differential presents a natural threc-dimensiofi^^.^. 
data box. Aneilyzing the components separately for each concept tends to 
Ignore the basic structure^'=^the^ as does collapsing the data over 
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concepts^ An ideal analysis should involve some form of a three^mode pro- 
cedure such as the one proposed by Tucker (1972). 

Should one, however, choose a conventional analysis strategy^ the 
overall and individual Measures of Sampling Adequacy will be useful in reaching 
appropriate decisions regarding the quality of one's data set* The overall 
measures provide important information as to whether the data should be 
factored at all. The individual measures might provide information as to 
which variables should be included in subsequent data collection and analysis 
stracegies, A variable which is universally poor is probably a good candidate 
for deletion. On the other handj scales with erratic sampling adequacy 
characteristics may be well suited for soma concepts and not for others* This 
scale by concept interaction has long been recognlEed so we re-emphasize that 
scale selection is a critical step in the assembly of a particular Semantic 
Differential, The Individual MSA's might bo further helpful in this context 
since with the SD one is factoring single scales with their presuu:ed low 
reliability instead of batteries of tests. Accordingly, we feel the concept 
of psychometric sampling adequacy should provide a helpful guide to the analysis 
of Semantic Differential and^ recommGnd that^one scrutinize his/her data by 
examining the associated overall and individual MSA's. 
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Table I 




Overall MSA's 


and Number 


of Components 


Concept 


HSA/^ .i 


^ of Components 


Quicksand 


.88 


g : 


Death 


.85 


1 


White Rosebuds 


-92 ^ 


. 1 


Hero 


.95 


3 


Gentlaness 


*92 , 




Success 


-93 


5 


Total 


-88 


6 
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Table 11 



Individual J( 



aaiures of Sanipling Adequacy* 




Passive/Active 
Soft/Hard 

Coapleti/Incoinplete 
ExciEabla/Calin 
Good/Bad 

l^'eak/SErong- :• 
Awkward /Graceful. ,., 
Fast/Slow 

Tanacious/Yielding 

Frai/CQtis trained 

Plaasurabk/Paiiiful 

Energecic/Inert 

Slinple/Coiplax 

Si rious/Llghc 

Cold/Hoc 

Thlck/TMn 

Beautiful/Ugly 

Severe/Lenient 

Easy/Difficult 

Larp/Siiiall ; 

EinQtlenai/UneniQCionil 
Uni'ttnely/Tiniily . 

Ughc/Heavy 
Cruel/Kind". 
Dead/Alive 
Moving/Still , 

Meaningful/Heaninglass 
Masculine/Feiinina ■ 
Uniiportant/Iniportant 
'PosiElve/Kigatlvi 

*Didniali Omitted 
, MSA;.< .70 Underlinad 



White , 
Rosebuds:. Hero 




94 


■ 91 


53 


93 
79 


93 


,93 

M 


96 

■ 96 
92^^ 


92 


9§ 


OA 

89 
91; 


9?-; 


OA 


: :94 
96 




95- 


£ 
91 


97 


^ 91 


93 
96 


M 


93 


89 




-94 


96 


92: 


81 


53 . . 


90' 


90 


: 96 


50 


55 


3l 


. 94 V 




: 90 


93 
92 


95 . 


63 


93 
97 


94 
95: 


.97 


93 


J6 
93 


96 


95 



Geiitl 



ensss: 



£ 
94 
96 

/: as 

91 

88- 
93 
.:91- 
89 
96 
94 
88 
87 

: 80 ■ 

89 

:ai 

94 
87 
94: 
; 88 . 
9S 
92 
-94 
90 
94 
89 
92 
84 
92 
.94 



' Sueceas 


Quicksand 


Death 


Mitrlv 


on 


86, 


I 


78 




Oi! 
06 


"87 


75 




86 


92 




92 


68 


89 


?J 


91 


90 


89 




■ 05 ■ 


59 


79 


qo 


84 


83 


88 


■ 64 




65 


8D 




90 


71 


90 


IL 
tit 


92 


87 


93 


90 ■ 


, 91 


91 


?y 


68 


87 


89 




71 


78. 


80 


5J 
□J 


94 


87 ' 


88' 


87 


^3 


77. 


;92 


93 


75 


91 


94 


92 


86 


91 


90 


93 


■ 93 


91 


91 


90 


86 


90 




92 


Jl 


91 




88 


85 


84 


QA 


81 




90 


93 


89 


89 


-JO 


0 J 


83 


89 


84 


93 


75 


90 


87 


.95 


89 


83 


90" 


95 


62 


73 


91 


-86 


85 


78 


89 


92 

.95 


73 


72 


81 . 


89 


83 


94 



Table III 



Summary of the Scales 
for I^hlch Deficient MSA^s Were Found 



Whit 



a 



Rosebuds Hero Gentleness Success Quicksand Death 



Passive/Active 59 , - 

Excitable/Calm ^_ _Z J_ ~~ 68 

Weak/Strong 46 . I Z ^® 

Fast/Slow _ ~_ ~, ~- 59 

Energetlc/Inart 67 - ~_ ^° 

.Cold/Hot 46 — "~ 

Moving/Still 53 _~ " ~ ~~ 

Meanlngfui/MeanlngJ.ess — " 72 

62. — — 




